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0.  ABSTRACT 

In  estimating  tlio  roof  1  ieient  of  an  cMulo;.',t'm'us  variable'  in  a  single 
equation  of  a  system  of  litiear  equations,  Aculi-rson  and  Sawa  (1V7'J)  ex¬ 
pressed  the  distribution  of  the  two-sta.',e  U'a.st -seiuares  (TSI.S)  e'slimator 
as  a  douhiv  noneentral  K  il  i  s  t  r  i  hut  ion .  UV'  relax  tlu'ir  assumption  of  in- 
depeiuic'nt  Caussian  errors,  taking  instisul  a  se.i  K'  mixture  of  spberie'al 
Caussian  laws  in  a  class  cuMitaining  the  spheriea!  stable  d  i  st r i but  ions . 
i'lie  resulting  el  is  1 1  ibuL  ion  of  the  TSI.S  estim.it  or  is  a  mixture'  of  eloulilv 
nom'enti'iil  F  di.st  ri  hut  ieins  nixed  over  the  nom'e'ntr.'il  i  ty  iitirtimete'rs,  ;uul 
for  suitable  mixtures  the  norma.l-thee.'ry  distribution  is  robust.  Computa¬ 
tions  reiiorte'd  fe'r  eontamin.ated  spherietal  Caiissitin  ;ind  sphe>rieal  C.iuehv 
errors  are  compared  with  the  .standard  ctise. 

1.  INTRODUCTION 

V.irious  preie'jdures  have  been  advornteel  fe'r  es  t  im.-i  t  i  ng  the-  eoel  f  i  e'e'iit 
in  simultaneous  systems  eif  Linear  equations.  Arguments  suppeirt  ing  tlie'se' 
pre'cedures  e'ften  appeal  to  asympte'tie'  pre'pe'r  I  i  is  I'f  the  est  im.itors ;  r: 
preictife,  lu'Wever,  their  sma  1  1 -samp  I  e  prope'r-.ies  .arc  e)  c  interest  .as  e.;e' 1  1  . 
A  re'c'e'iit  survey  of  .app  I  ic.'ihl  e  sm;i  I  I -samp  1  e>  d  i  s L r  ibu t  ie'u  the'e'rv  was  unde'i  - 
t.aken  by  Mtiriano  (I9.S()).  One  tee-hnique  in  wide'  u.sage  is  two-st.i,.',e 


Ackne'wl Judgment .  Support  was  provided  in  part  by  I  hc'  D  .  S  .  Arme-  Re'seareh 
Office  through  ARC  Grant  Ne).  I)AAC-29-78-C.-0 1  7  . 

Key  Words  and  phrases.  S imultaneejus  equatiein.s;  twe>-.st.age  letist  squares; 
spherical  error  distributions;  mixtures  of  distributions;  robustni'ss . 


U'ast-squart'S  ('I'Sl.S)  (.si:  imat  i  on  uik1i.‘I'  t  hi'  stanilaid  assiini;'!  i  on  lliat  orrors 
of  tho  iiukJoI  arc  Lndi.'pi;ndL‘nt ,  idont  i  c.i  1  1 d  i  s  t  c  i  hot  od  (iid)  (lainisian 
variables.  Ihidc.  r  th(.‘sc  assumplions  Anders. >n  and  Sav.i  (  1  h i .  1 '• /<) )  derived 
.111(1  later  tabulated  '.he  exact  d  i  s  t  r  i  Init  i  on  ol  1  he  I'Sl.S  esiiriMtor  f.'i'  tin' 
coe  f  f  i  e  lent  of  an  endogenous  variable  in  a  siin'le  tanialien  e|  ,i  lineir 
systi'ni.  Raj  (19.S0)  studied  effects  of  noii-tiauss  i  an  errors  ,  ti  '.'.i  r  i  ens 
estimators,  including  the  'I'Sl.S  estimator,  iisini',  Monte  (larlo  ru  ihods.  I'o 
date,  however,  analytical  investipat  i.'ns  of  thi'  distributions  if  ISIS 
estimators  ap|iear  to  havi‘  lieen  confiiu'd  to  tlie  standard  casi'  ei  iid 
(iaussian  i>rrors. 

In  thi.s  paper  we  study  tlu-  exact  distribution  of  the  'I'Sl.S  estimalor 
lor  the  coefficient  of  an  endogenous  v.iriable  in  a  sinple  ec]nati('n  under 
lU'iistandard  assumptions,  replacinf;  iK'rii'ality  with  .an  error  distribution 
in  the  class  of  scale  mixtures  of  spherical  Caussiau  laws  (cf.  Kelker 
(1970),  lor  exaiiipli').  Our  reasons  for  cons  iiler  inj;  'liis  class  follow. 

(i)  liepinninp  with  Mandelbrot  (1960, |9h}, 1969)  ,  infinite-variance 
(I  i  s  t  r  i  liut  i  uns  inciuding  tlie  stable  laws  have  been  used  to  nuule  1  economi.' 
v.iriables  such  as  stock  prices;  cf.  also  l•^lnl.l  (166'i),  Mctai  1  I  oii;',h  (  i ^ 
I’ri'Ss  (  1973),  and  Saiiiuelson  (1976).  TIu'  clas:.:  considi'red  here  cont.iins 
the  spherical  st.ible  laws  and  other  lu'avy-ta  i  I  id  distributions  whose 
marginals  figure  iiromincnt  ly  in  the  work  citi'.l. 

(ii)  1  he  distributions  of  .Anderson  and  S.iwa  (1973,1979)  give  .ipproxi- 
niations  in  the  case  of  non-C.auss i an  errors  .ittr.u'ted  to  the  Oaussi.in  law 
under  conditions  for  central  limit  theory.  I  he  present  study  vields 
approximations  in  the  case  of  errors  not  having  second  moments  whose  dis¬ 
tributions  are  attracted  to  a  spherical  stable  l;iw. 

(iii)  Our  approach  admits  a  Bayesian  view  in  which  the  distributions 
studied  ;i re  (losterior  distributions  of  the  'I'Sl.S  I'stimators,  the  errors 


bi'iiiK  coiul  i  L  iona  1 1  y  iid  (laussian  wi!li  a  scaU'  iiaranu’ti'r  di  •  l  l- rri  i  ik- J  liv  llu' 
i  lm  1  i /.at  iiMi  of  a  rainloiii ,  latv i  ronmoiu  . 

(  Lv)  riu'  inaliiiarv  1  oasL-s<|iia ros  csL  inialors  in  a  .'.cnor.il  liiioar  inoilol 
afi'  known  to  retain  oortain  optimal  propiTl  i  undi-r  siiiurioal  iTrni'.'-;  witli 
aiul  without  monu'nts  (of.  .lonsen  (l‘)79)). 

(v)  i'or  oritioal  linear  systems  st.it  istioal  oontroi  oh.n't  s  m.iv  iie 
deviia-J  for  monitoring  the  st.it  ionar  i  tv  of  a  struotui'al  rel.it  ion  Ii.islcI  on 
(laussian  error  (iroi'essos  ainl  t  lie  work  of  .\iKli-rson  .iiul  Sawa  (lo7j).  Ti,,. 

present  studv  lays  t  lie  I  ouiui.it  i  ons  for  ili'Ve  1  op  i  ny  .such  procedures  in  (lie 
e.'isi.'  of  splierieally  invariant  prooessi's,  .is  siioii  processess  iiiav  lu'  representi. 
.IS  scale  mixtures  of  spherio.il  (laussian  proces.ios  (of.  Hartman  ami  WiiUnor 
(  19'.0))  . 

Our  program  of  study  follows.  In  Section  J  wo  demonstrate  undiT  so.ile 
mi.xture.s  that  the  distribution  of  the  TShS  estimator  is  a  mixture  of  doubly 
nonoentral  i’  distributions  mi.xed  over  their  nonoen  t  ra  1  i  ty  parameters.  livi- 
denoe  is  given  supporting  the  view  that  norma  I -iheorv  distributions  are 
roiinst  for  certain  mixtures.  In  Section  3  selected  percentiles  of  tlie  i'SI.S 
estimator  are  presented  for  contaminated  spliericai  (l.iuss  i  .in  and  sidierical 
(J.uicby  errors,  and  lliese  are  compared  witli  the  standard  d  i  s t  r  iluit  i ons  . 

2.  NONSTAoDAKI)  1)1  STKT  lUM  iONS 

Let  A(r/s)  lie  a  matrix  of  order  (rxs);  denote  by  L(/.)  =  N  (M,l  '<Z) 

r ,  s  ^  '  r 

that  /.(rxs)  is  a  random  (laussian  matrix  with  I’xpeetat  ion  i’.(li)  -  M,  the 
rovxs  of  /.  being  independent  with  tlie  sami'  dispersion  matrix  )l(s<s);  and 

't 

let  (1  (M,l  xf)  be  a  scale  mixture  of  the  (laussian  laws  {N  (M,t"(1  xp)); 
r ,  s  '  r  -  r ,  .s  ^  ’  r  ' 

1  i.  (0,'")  1  wliose  probability  density  function  (pdf)  has  the  represeiuai  ion 

g(Y)  =  (27t)‘''‘‘’''^j^“’|T^rr’'''^exp[-tr(Y-M)  '(Y-M)r~V2T^]d(l(T) 

2 

witi'  (l(r)  a  mixing  distribution  on  (0,«>)  .  I’urtlier  let  x  (v,A)  he  the 


(2.  1) 


ch  i-squarod  distrlbuLion  Itaving  v  dei’.ri’L's  I'f  l  aiul  Ihr  :  > 'lufii  t  r.i  I  i  t 

[laramcLrr  A,  and  Jot  l•'^,  r  )  bt'  tlu‘  tlmiblv  tK'iua'iiL  ra  I  i-  d  i  ;  t  r  i :  ii  l  i  an 

with  numerator  parameters  (r,^)  and  lU'uomi na l o r  parameters 

t'o  1  lowi  nj;  Andi-'rson  and  Sawa  (1973),  eoiUMdef  .1  s  i  n;’,  I  e  striietur.il 
equation  of  tbe  tvpt’ 

V)  =  Py,,  +  +  >. 

where  Vj  and  y.^  are  I'olumns  (il  the  vilise  1  vali  1 1-  matrix  Y('l'''2);  /  |  (  T  •  K  ^ 
a  la.itrix  of  rank  K  T  (-ous  i  s  t  i  ii)’,  of  known  is-;o'.',enous  variabli's; 
is  a  veetor  ol  parameters;  .ind  u(r-;|)  is  .in  orror  veelor.  'I'be  stru  tur'l 
equation  {'1.2)  is  .1  member  of  a  svslein  of  liiie.ir  equ.ilions  whiu;e  i-edm  ed 
form  equ.iLions  .ire  ia  pi\sa-nt  ml  bv 

Y  =  Zil  +  V 

wliere  Z  =  (ZpZ,j)  is  a  matrix  of  order  (TxK)  and  rank  K  T  of  exoy.enoii  . 
vari.ibles;  I!(K>:2)  is  ;i  nt.itrix  of  reduced  form  p.ir.'iiiii't  ers  |)arLil  i  oned  s 


conformably  with  Z ;  and  VC'l’xZ)  is  a  matrix  of  random  disturbances.  It  is 

assumed  that  (y j  ,  11 22^  unit  rank  and  that  ^  0.  Anderson  ;ind  .Sawa 

(  1973)  studied  tin.'  k-class  estimators  for  ;■  in  (2.2)  under  the  assumption 

that  i(V)  =  N  ,,(0,1  Si,)),  with  Si  =  ['.'..1  a  (2-2)  matrix. 

1,21  -  1  I 

i'o  find  the  distribution  of  the  TSLS  e.st  imator  for  B  under  scale  mix¬ 
tures  of  spherical  (laussian  Jaws,  we  proceed  as  in  Anderson  and  .Sawa  (1973, 
1979)  alter  cimd i t ion  inp  on  the  mixing  parameter.  Their  reduction  to  a 
canonical  form  and  several  subsequent  transformations  ,iro  valid,  condition¬ 
ally,  for  scale  mixtures.  Thus  starting  with  expression  (2.7)  of  Anderson 


and  Sawn  (1979),  wa  ohLain  tiu-  followins',  in  i  :<  I  ii  if  r.'n  m :  .mi  t ,  1 1  i  "ii  fi'i'  (lu- 
I'ur'ui  I  a  t  i  Vf  tl  i  s  I  r  i  but  i  on  ’  f  uiu' I  ion  ((.df)  ot  tlu’  n  t  .ind.i  rtl  i /Ltl  I'SI.S  ^■.'ai^^ltor 


h 

ci'iul  i  L  i  on  in;’  vnrinblc  :  i-nti-r:;  t  lu’  diuibJy  luni'  i-nt  f.i  1  !'  .1  i  ;  t  r' i  mU  i  on  only 
tiunniyli  its  noncoiit  la  1  1 1  v  iKiraniolors  .  Tlio  iiiiioiu!  i  t  i  ona  1  oill  ol  ;  lu¬ 
st  aiula  rcl  i  zod  ISIS  L'stimator  tiuis  is  a  viixlnro  ol  vloui-l-.-  noma  nt  r.;  1  dis- 
trilnitions  inixod  ova-r  thoir  nonctnt  I'a  I  i  t  v  |)ar.imotors  ,  i.n., 

I’t  '  -“(b-S)  x)  =  /  l’(w'w  /w'w,  ti  (  r )  I  i  I  i'i( ,  (  ;  I  .  (".'.b) 

O  -  0  I  I  m-  - 

It  is  clear  from  laanarks  on  i)ai;o  704  ol  Anderson  and  Sawa  Lbit 

[larallol  results  can  lx.’  ol)tained  for  the  ordinary  1  c-.as t -squa r. -s  tul.S) 
estinator  b^.  (loria’spond  i  ny,  to  (2.9)  we  bava- 

'i 

i’(  “■■(b  -b)  '  x)  =  /  Pfw'w  /wlw,  c(i-)  I  i  )d(;([  )  (2.10) 

1  -  ^  .K3  -  a  a  - 

where 

l,(w'v-/  /w'w  )  =  I- (T-K  ,T-K  .  ■  (  i  )  ,  \  ( i  ) )  .  (2.11) 

J  •  4 ■  a  1  1  I  2 

The  only  difference  lu'tween  (2.9)  and  (2.10)  is  the  number  of  decrees  of 

fn-i-dom  of  tiu-  iloul)  1 V  noiu'entral  f  ilistribut  ion. 

Wi-  conclude  tliis  si.-ction  willi  a  brief  look  at  the  possible  robustness 

ol  the  no  rma  1  - 1  boo  r  V  tl  istriliut  ion  of  the  TSI.S  e^.'  iiaator  a;;ainst  error  dis- 

trilnitions  arisin;’,  as  scale  mixtures  I’f  spherical  Caussian  laws.  Anderson 

and  S.iv;a  (  1979)  provided  t.ibies  fur  the  cilf  of  tIu’  standardized  TSI.S  esLim.i- 

) 

tor  in  terms  of  I  lie  deitroes  of  freedom  (K.^)  .uul  tiu-  pai'ameters  i.  and  .S  “  de- 

t  ined  in  (2.7)  and  (2.S).  Tlie  values  of  K,  .and  i  are  invariant  under  tlie 

■)  '’2 

scale  i.'li.an;;e  u  >  [u  in  tlie  errors,  wlu’reas  4“  •  6''/r^.  'fhu.s  tiu-  idf  of 

the  standardized  TShS  estimator  under  scale  mixtuta-s  ol  tiaussi.an  errois  is 
a  weiy.hted  average  of  the  norma  1 -tbeorv  cdf's  ciirrespond  i  ni;  to  diflAient 
values  of  6. 

A  perusal  of  the  tables  of  Anderson  and  Sawa  (inyq)  show,  that  the 


standardized  cdf  ofti’n  remain.s  ftiirly  .stable  over  .i  w  I  tU-  ranye  of  values  I'f 


/ 


Mt.xturis  over  tlie.si'  ranges  aeeoiai  i  iig,  1  v  .sImiiIi!  ■■iilil 

d  is  I  r  i  InU  u  ns  for  which'  tlie  norma  1 -t  In-orv  d  i  l  r  i  lui  t  i  on  i';!,  i  !  ■  .  ■  : 

is  roluist.  io  i  1  1  us  I  I'.i  t  e  ,  c'onsider  I  he  two-point  in  i i  nc.  .;i  .i;  i  out  i  :i 
■>  2 

i  (i“  =  l)  =  p  =  1  -  1’ (  I  ='>)  whicli  givis  a  con  t  aiii  i  na  1  ed  splui  i,.,!  .uu.  i 

error  distril>ut  ion.  If  t  lie  unconditional  ISL.s  estimator  ,  it  ,  -  .  . 

‘  “  -  SOOO  with  a  fixr'd  iniramet  i-r ,  then  its  cdt  is  a  uiiy.ture  oi  i;  s  i'  ' 

•)  1  )  ,  . 

theory  cdf's  cor  rt'spond  i  up,  to  S"/i"  -  1(100  wh.  ii  ;  =  a  aiul  t’  ’  /  ,  )'/(lo 

■) 

wIk'ii  i  ^  =  1.  Se  1  ei.' t  isl  points  of  till'  |■esultin:•  cdf  weri'  evuluiied  fiu’ 

I  io,!,')!,  ,  ii.lO),  and  p  -d .  aO  ,  O  .  7 ')  ,  O  .  00  !  using  the  tal.l.s  of 

Anderson  and  Sawa  (lOfO);  the  results  .are  g.iven  in  fable  'd .  1  ti>r  K  ,  =  3  md 

in  fabli'  .  d  for  K.,  -  10.  .A  comparison  oi  the  norm.i  1  -  theory  d  i  ..t  r  i  iuit  i  eu'  ; 

IS  ap|)ro.\'ii!iat  ions  to  tin'  distributions  under  ::i  i  t  ti  res  confinas  tiii'  rohi  n .  L  :ie,-; 
of  the  former  under  ci'rtain  type.s  of  mixtufi's. 

In  the  following  section  we  undertake  a  liroader  study  of  tlie  d  i  s  t  r  i  !iu  t  i  on 
of  the  stanilard  izi'd  'fShS  estimator  undi-r  various  i-rror  d  i  st  r  i  hu  t  i  rms  . 

J.  KflSUl.TS  AND  !'lS(d'SSl0N 

In  oriler  to  compute  tiie  cdf  ol  the  s  t  and  i  rd  i  zed  ISh.S  esli'i.'itor  under 
various  choices  for  the  mixing  d  ist  r  i  Init  i  on  (■(:),  we  follow  a  I'roci'd'ure  lii-i- 
flar  to  the  one  sketehed  at  the  end  of  the  I'li'ceding  sect  ion.  I'irst,  lor 
I'acli  fixed  v;i  I  ui'  of  the  mixing,  par.imetert,  flu-  cdf  of  tho  douhlv  nuuceiitr.il 
1'  distribution  is  com|)uted  using  the  .algorithm  suggested  bv  Anderson  and 
Saw.i  (1979).  file  resulting  values  of  tlu'se  cdf's  are  then  misi'd  over  tlu' 
relevant  values  of  r  aeeording  to  fills  procidure  is  straightforward 

when  (!(t)  is  discrete.  for  continuous  mixtures  the  edf  (1(t)  is  discretized 
,it  the  second  step  on  partitioning  ((),“>)  into  interv.ils,  assigning  the  prob- 
utiilities  to  mid-points  of  these  intervals,  and  proceeding  as  for  the  dis¬ 
crete  l  ase.  I'his  procedure  is  expected  to  give  good  approximations  t(i  thi' 


ri' t  i  ni'i!  su  t  1  i  >  i  m  t  I  . 


.u'tual  distributions  wliun  tlu'  d  i  st' ru  t  i  s.i  t  i  >  ni  is 

Our  nunn.'rii'al  stud.ius  iMU'oiiipass  tbri’i'  di  .••roti'  irixturrs  ol  I'm- i  m 'u  i  i  i 

and  biiuimial  typo  i^iviii};  contaniinat  ad  spiii-rii-.il  Oaussi.ai  arrai.,  and  an<- 

ri'iU  i  micnis  iiiixturo  usiu);  an  invarsi-  a!ii  d  i  s  t  r  i  Inil  i  an  w'aiili  -i-.a;;  :,;nari.al 

Caualiv  arrors.  Tlia  latti'r  i  s  an  axaiiip  1  a  at  a  d  i  s  t  r  i  tin  i  i  i>n  ii.i',' i  in'  .laa.-.is'a 

) 

tails.  In  particular,  our  Vvna  1  can  I  ainina  t  i  an  iisas  ‘I'ii'-l)  (I.S). 

2  .  2  ' 

!’(;‘'=10)  =  O.Ob];  ivi'a  2  cant  am  i  na  I  i  an  iisi's  ii’(t  -1)  0.'),  !'(  10) 

•) 

O.V:;  and  Tviu'  >  can  t  am  i  na  t  i  on  assii'.ns  iirabab  i  I  i  t  i  as  la  i  .  •  1,2 . Id| 

accardini;  ta  Ilia  binamiai  d  i  s  t  r  i  but  i  an 

(  t.  I  ) 

V.  i  I  h  r  =  : "  -  1.  i'lK'Si.'  disi-ri'ta  mixturi-s  pasa  na  diftii'ulty  in  i  ha  lamici- 
ta  l.  i  ons  . 

riia  spbarical  Caiudiy  arror  law  is  a  i-d  i  mans  i  ana  1  splK’rical  S’ndant''. 
di.st  rilnit  ian  liaviny,  unit  dop,rea  at'  fraadom;  multivariate'  Student's  ai'rai's 
wi’f''  aansidari’d  bv  /.allnar  (1976)  in  aannactiaii  wirb  01. S  astimatian  in  a 

p.anaral  linaar  itioiU' 1 .  Spherical  Cauchy  arrors  in  'I'ShS  astimatian  arc 

_ )  ■’  2 
obtained  from  L(t  ")  =  on  evalutitinj;  the  cdf  of  t'Cl,*')  over  .idb 

intervals,  assit;nin,i;  the  probabilities  of  thasa  intervals  to  t  lie  tai  ipracal 

of  their  midpoints,  .iiui  than  mixin.i;  tlia  douli  1  v  noiun'ii  t  la  1  !'  il  i  s  t  r  i  bn  l  ions 

oval'  tbasa  values.  .As  doubling  the  nnml)er  of  intervals  Iru!  little  affi'ct 

on  tlia  values  of  the  cdf  of  the  I'Sl.S  estimator,  tlu'  cboica  of  226  intervals 

lor  tile  discri'tc'  approx i m.a t  ion  was  di-i'iiiad  adi'quata.  TIu'  lour  tvpas  ol  .lOx- 

turas  studied  in  this  section  are  summarized  for  convenience  in  Table  3.1. 

Selected  perci'iit  i  las  of  the  distributions  of  t  Ik'  TSi.S  estimators  are 

given  in  Table.s  3.2  -  3.7  along  witli  the  i  n  I  a  tapia  r  t  i  1  a  range  as  a  measure 

2 

of  concentration.  I’he  range  of  parameters  iiu' hides  iS  c  {  100,300,1000, 

3000 1  ,  a  f:  {0,1,31,  and  tiie  degrees  of  Freedom  K  > 


{3,10).  The  va  I  lies 


■IT'. u'S  ar'c 


taluilatod  hy  AnJorson  aat!  Sawa  (1979)  I'nr  sii'iu' r  i  aa  1  'aiisaiaii  < 

!;ivi'n  alani;  willi  >uir  own  lamiHilaL  ions  for  t  he  llirai'  lanu  ai:i  i  n  a  i  ion  inodcls 

aiul  for  Hpliorii'a!  Caiu  liv  .arrors.  flu-  im-diaio:  and  lln'  tail  p  i  o '  mIi  i  I  i  f  i  os 

fi'iH'rted  aiipoar  ti>  hi'  aoi'iiral-L'  within  +0.01,  wh  i  1 1’  tho  i  iiLi  ‘  rqna  r  L  i  1 1' 

1  any, os  niav  ho  iivoia;latod  hy  an  amount  in  I  ho  ran;;o  (O.OO.O.OJ). 

Sovoral  i  h.i  rao  t  o  r  is  t  i  os  of  tho  fSI.S  i-stiriatof  wore  noti'd  h-.-  Andoi  son 

and  Sawa  (1979)  in  tho  I'aso  of  i  id  ''.a'lssian  orrors.  riiosi-  ^:a::;o  ti  iidoiu  ios 

aro  I'xdiihiti'd  undiT  tho  adtlitional  orror  d  i  s  t  r  i  hiit  i  ons  oonsidoiad  :.oro. 

irst,  I'xoi'iu  when  i  -  0,  tho  'fSI.S  i-.stiniator  has  nogativc  modian  bias. 

I'll  i  s  bias  inoroasos  with  i  and  with  tho  di'i;roos  of  1  roedom,  K,^,  hut  it 
) 

di'oriMSi's  with  Sooond,  tho  dispi'i'sion  ol  I  ho  TSl.S  ostiiiialor,  as 

inoasuri'd  hy  tho  1  n t o rqna rl  i  I  o  rany.o.  ilooroasos  as  i  and  K,,  increase',  hut 
2 

it  increases  with  Together  tltese  two  ohsofvations  imply  that  as  a  or 

K.,  increase,  the  TShS  estimator  is  more  ti>;\aiy  rorn'entrated ,  hut  about 

vtilues  lurther  removed  from  the  true  value  of  the  parameter.  The  .same 

2 

holds  true  for  decreasing  values  of  . 

In  tho  preceding  section  we  noted  that  the  only  difference  between 
till'  01, .S  and  TSLS  cstimator.s  lies  in  the  degrees  of  freedom  of  the  doubly 
nonei'iitra]  F  dlstr  ihut  ion.  In  most  practical  circumstances  one  wouiil 
e.xpect  the  number  of  degrees  of  freedom  for  the  01. S  estimator  to  be  greater 
than  that  for  the  TShS  estimator.  From  the  foregoing  discussion  we  would 
then  expect  the  OLS  estimator  to  have  greater  bias  but  smaller  inti’iapiart  i  le 
range  than  the  TShS  estimator.  Althougji  thi'  OhS  estimator  is  not  studied  hei 
numi'rically ,  our  expectation  agrees  with  results  found  hy  Raj  (1980)  in  a 
Monte  Carlo  study  using  independent  lognormal,  uniform,  and  double  expo¬ 
nential  errors. 

Comparing  properties  of  the  TShS  estimator  under  lumstandard  error 
distributions  to  those  for  Gaussian  errors  In  'fables  '3.2  -  3.7,  we  note 


in 


that  till’  liK'clian  bias  for  tlu-  nonstandard  orrors  is  novor  loss  than  tli.it 
for  Caussian  oi  rors.  t:bmpar Isons  of  tho  lntorc|u.!rt  i  I  f  rani't's  sin'.K*- t 
that  niixint;  aflocts  location  of  tlio  derived  distribution  of  tlu‘  TSI.S 

estimator  to  a  p.reater  extent  than  scale. 

2 

For  larce  values  oi  tl^e  parameter  it  is  seen  that  tlie  normal- 
tlieory  distribution  is  reasonably  robust  aj^ainst  contaminated  naussi.in 
errors  of  Types  1  and  3.  Type  2  contamination  and  Faiicliy  erri'is  vii'KI 
distributions  less  resembling  those  for  the  standard  ease.  From  tliese 
studies  it  appears  tliat  rather  small  departures  from  tlie  standard  (laussian 
assumptions  are  not  crucial  over  a  modestly  wi<le  range  of  the  iiarameters 


of  tlie  distributions. 
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TABLK  2.1.  Distributions  of  the  stand.irclized  i'SI.S  ('stinator  mub  r  (  i)  (tuissian  errors 
with  S'/  i'  =  1000,  (b)  Gaussian  errors  with  6‘Vi'  =  'lOOO,  and  (r)  out  an.inaled  (.aussian 
errors  obtained  as  a  mixture  of  (a)  and  (b)  witli  proportions  1-p  and  p,  nsiH'c  t  i  ve  1  y , 
for  K.,  =  3  degrees  of  freedom. 


a  =  0 

a  =  1 

1  =■  3 

X 

(a) 

(b) 

(c) 

p=0.50 

(a) 

(b) 

(e) 

p=0. 75 

(a) 

'b) 

(e) 

p=0.90 

-3.00 

0.0014 

0.0014 

0.0014 

0.0009 

0.0011 

0.0010 

0.0005 

0.01)09 

0.0009 

-2.00 

0.0229 

0.0228 

0.0228 

0.0202 

0.0217 

0.0213 

0.0191 

0.0212 

0.0210 

-1  .00 

0.1587 

0.1587 

0.1587 

0.1664 

0.1612 

0.  1620 

0.1667 

0.1623 

0. 1627 

-0.20 

0.4209 

0.4210 

0.4209 

0.4383 

0.4287 

0.4311 

0.4451 

0.4317 

0.4331 

0.00 

0.4997 

0.4997 

0.4997 

0.5175 

0.5077 

0.51 02 

0 . 5245 

0.5109 

0.5123 

0.20 

0.5791 

0.5790 

0.5790 

0.5960 

0.5866 

0.5890 

0.6025 

0.r'809 

0. 5910 

1.00 

0.8413 

0.8413 

0.8413 

0.8465 

0.8436 

0.8444 

0.8485 

0.8446 

0.8450 

2.00 

0.9771 

0.9772 

0.9772 

0.9750 

0.9762 

0.9759 

0.9742 

0.9758 

0.9757 

3.00 

0.9986 

0.9986 

0.9986 

0.9979 

0.9983 

0.9982 

0.9976 

0.9982 

0.9981 

TABLK  3.1.  Description  of  the  scale  mixtures  of  spherical  Gaussian  errors 
studied  numerically. 


Type 

Descr i pt ion 

Type  1 

P(t“=I)  =  0.95 

;  r(r“=10)  =  0.05 

Type  2 

P(t^=1)  =  0.5  ; 

1’(t“=10)  =  0.5 

Type  3 

P(T^=r+l)  =('/) 

(0.05)’'(0.95)^^"'^ 

r  c  {0,1,... 

,15} 

=  X^l.O) 


Cauchy 


lABl.l'.  ;}.2.  StUoL  tt'd  iJorciu'.  t  i  ]  es  ;incl  rniigf  of  ihc 
various  scalo  mixtures  of  Gaussian  errors  for  K., 
v.irious  'S'^  . 

‘  TSI.S  fsLimatnr 
=  3  degrees  of 

under  Gaussian 
freedom,  a  =  0, 

and 

and 

■  ' 

KRROR 

DISTRIBUTIONS 

QUANT  ri'Y 

Gauss i an 

Type  1 

Type  2 

Ivpt'  3 

Cauchy 

6*’  =  100 

Med  ian 

0.00 

0.00 

0.00 

0.00 

0.00 

Interquart ile 

Range 

1.34 

1.34 

1 . 30 

1  .34 

1.20 

2.5  Percentile 

-1.98 

00 

-2.03 

-1.99 

-1.96 

97.5  Percentile 

1.98 

1.98 

2.03 

1  .99 

2.00 

o 

o 

II 

Median 

0.00 

0.00 

0.00 

0.00 

0 . 00 

I  n te  rquar t ile 

Range 

1.35 

1.35 

1  .  34 

1  .35 

1.26 

2.5  Percentile 

-1.97 

-1.97 

-1.98 

-1.97 

-1.96 

97.5  i'ercentile 

1.97 

1.97 

1.98 

1.97 

o 

c 

5-  =  1000 

Median 

0.00 

0.00 

0 . 00 

0.00 

0.00 

Intcrquarti le 

Range 

1 .  35 

1.35 

1  .  35 

1  .  35 

1  .  30 

2.5  Percentile 

-1.96 

-1  .96 

-1.97 

-1.96 

-1.96 

97.5  Percentile 

1.96 

1  .90 

1  .97 

1 . 96 

2 . 00 

=  5000 

Median 

0.00 

0.00 

0.00 

0.00 

0.00 

Interquartile 

Range 

1.35 

1  .  35 

1  .  35 

1  .  35 

1  .  34 

2.5  Percentile 

-1.96 

-1.96 

-1.96 

-1  .96 

-1  .  9t) 

97.5  Percentile 

1 . 96 

1.96 

1.96 

1.96 

1  .99 

TABLE  3.3.  Selected  percentiles  and  range  of  the  TSLS  estimator  under  Gaussian  and 
various  scale  mixtures  of  Gaussian  errors  for  K2  =  3  degrees  of  freedom,  a  =  1,  and 
various  6^. 


ERROR 

DISTRIBUTIONS 

QUANTITY 

Gaussian 

Type  1 

Type  2 

Type  3 

Cauchy 

62  = 

100 

Median 

-0.14 

-0.16 

-0.28 

-0.18 

-0.26 

Interquartile 

Range 

1.32 

1.34 

1.24 

1.33 

1.16 

2.5  Percentile 

-1.84 

-1.83 

-1.80 

-1.81 

-1.82 

97.5  Percentile 

2.09 

2.08 

2.09 

2.11 

2.06 

62  = 

300 

Median 

-0.08 

-0.09 

-0.17 

-0.10 

-0.20 

Interquartile 

Range 

1.34 

1.35 

1.33 

1.34 

1.26 

2.5  Percentile 

-1.89 

-1.88 

-1.82 

-1.86 

-1.84 

97.5  Percentile 

2.04 

2.04 

2.08 

2.05 

2.06 

62  = 

1000 

Median 

-0.05 

-0.05 

-0.10 

-0.06 

-0.14 

Interquartile 

Range 

1.35 

1.36 

1.35 

1.35 

1.31 

2.5  Percentile 

-1.92 

-1.92 

-1.88 

-1.91 

-1.88 

97.5  Percentile 

2.00 

2.00 

2.04 

2.01 

2.04 

62  = 

5000 

Median 

-0.02 

-0.02 

-0.04 

-0.02 

-0.08 

Interquartile 

Range 

1.35 

1.36 

1.36 

1.35 

1.34 

2.5  Percentile 

-1.94 

-1.94 

-1.92 

-1.94 

-1.92 

97.5  Percentile 

1.98 

1.98 

2.00 

1.98 

2.02 

TABl.K  3.4.  Selected  perccntllos  and  r.inge  of  the  TSLS  e.stimntor  under  (;aussi.in  and 
various  scale  mi.xtures  of  Gaussian  errors  for  =  3  degrees  of  freedom,  u  =  3,  and 
various  6~  . 


KRROK 

01  SIR  I  BUT  I  ON’S 

Ql’A-NTlTY 

Gauss i an 

Typo  1 

type  2 

Type  3 

Cauchy 

6^  =  100 

Median 

-0.19 

-0.22 

-0.40 

-0.2  5 

1 

0 

CO 

Interquart i lo 

Range 

1.30 

1.32 

1.17 

1.31 

1  .  12 

2.5  Percentile 

-1.78 

-1.76 

-1.68 

-1.74 

-1 . 72 

97.5  Percentile 

2.13 

2.11 

2.07 

2.14 

2 . 04 

4^  =  300 

.Med  iaa 

-0. 11 

-0,12 

-0.2  3 

-0.  14 

-0.28 

Interquart i 1 e 

Range 

1.33 

1.34 

1  .  30 

1  .  34 

1.25 

2.5  Percentile 

-1.86 

-1.84 

-1.76 

-1.82 

-1  .  78 

97.5  Percentile 

2.06 

2.06 

2.10 

2.08 

2.06 

42  =  1000 

Med ian 

-0.06 

-0.07 

-0.13 

-0.08 

-0.20 

Interquart i le 

Range 

1.33 

1.35 

1.35 

1  .  36 

1  .  32 

2 . 5  Percent i le 

-1.90 

-1.90 

-1.33 

-1.88 

-1.84 

97.5  Percentile 

2.02 

2.02 

2.06 

2.03 

2.06 

62  =  5000 

Median 

-0.03 

-0.03 

-0.06 

-0.04 

-0.10 

Interciuart  ile 

Range 

1.35 

1  .35 

1  .  35 

1  .  36 

1.35 

2.5  Percentile 

-1.94 

-1.93 

-1.90 

-1.93 

-1.88 

97.5  Percentile 

1.99 

1.99 

2.01 

1.99 

2.04 

TABLK  3.3.  Selected  percentiles  and  range  ol  the  TSI.S  i'stimater  under  Gaussian  and 
various  scale  mixtures  of  Gaussian  errors  for  K..  =  IG  deitrees  of  frc*edoni,  (t  -  0,  and 
various 


(QUANTITY 

Gau.s.s  i.in 

Type  1 

KRROR 

DISTRIUUTIO.MS 

i'vpe  2 

Type  3 

Cauchy 

Med  ian 

0.00 

5^  = 

0.00 

100 

O.OO 

0.00 

0.00 

Interquartile 

Range 

1.29 

1.28 

1.13 

1  .  26 

1.02 

2 . a  Re rcen t  i  1  c 

-1.91 

-1.90 

-1  .75 

-1.88 

-1.76 

97.5  Percent  i  Le 

1.91 

1.90 

1.7  5 

1.88 

1.78 

Median 

0.00 

6?  = 

0.00 

300 

0 . 00 

0.00 

0.00 

Interquart i] e 
Range 

1.  J3 

1.33 

1  .26 

1 .  32 

1.14 

2.5  Percentile 

-1.94 

-1.94 

-1  .88 

-1.93 

-1.84 

97.5  Percentile 

1.94 

1.94 

1.88 

1  .93 

1  .87 

Median 

0.00 

6^  = 

0.00 

1000 

0 . 00 

0 . 00 

0 . 00 

Interquart i le 
Range 

1.34 

1.34 

!  .32 

1.34 

1.24 

2.5  Percentile 

-1.96 

-1.95 

-1.93 

-1.95 

-1.90 

97 . 5  Percent ile 

1.96 

1.95 

1  .93 

1  .95 

1.92 

Med  ian 

0.00 

6^  = 

0.00 

5000 

0.00 

0 . 00 

0.00 

Interquarti le 
Range 

1.35 

1.35 

1  .  35 

1.35 

1  .  30 

2.5  Percentile 

-1.96 

-1.96 

-1.96 

-1.96 

-1.93 

97.5  Percentile 

1.96 

1.96 

1.96 

1  .  96 

1.96 

TABLE  3.6.  Selected  percentiles  and  range  of  the  TSl.S  estimator  under  Gaussian  and 
various  si^ale  mixtures  of  G.iussian  errors  for  K,  =  10  degrees  of  freedom,  u  =  1,  and 
various  6". 


ERROR 

DISi RIBUTIOMS 

QL'ANTITY 

Gauss  ian 

Type  1 

Type  2 

Type  3 

Ca uchy 

62  = 

100 

Median 

-0.59 

-0.62 

-(;.H9 

-0.72 

-0.7! 

Interquart ile 

Range 

1.22 

1.22 

1 .04 

1.17 

1.03 

2  .  3  i'ercent  i  le 

-2.19 

-2.19 

.  20 

-2.21 

-2,1 5 

97.5  I'ercent  i  1  e 

1  . 4  A 

1.41 

1.10 

1.27 

1  .26 

300 

.Med  ian 

1 

o 

-0.39 

-0.')A 

-0.46 

1 

o 

oc 

Inter(|uart  i  Le 

Range 

1.30 

1.31 

1.23 

1  .29 

1.17 

2.5  Percentile 

-2,12 

-2.13 

-2.20 

-2.15 

-2.13 

97.5  Percentile 

1.69 

1.67 

1.42 

1  . 60 

1.52 

62  = 

1000 

Median 

-0.20 

-0.22 

-0.40 

-0.26 

-0.42 

Interquart  1 1 e 

R.inge 

1  .  33 

1.34 

1  .32 

1  .  34 

1 .  30 

2.5  Percentile 

-2.06 

O 

1 

-2.13 

-2.08 

-2.10 

9  7.3  Percent  i  J  e 

1  .83 

1.82 

1.67 

1.78 

1.71 

62  = 

5000 

Median 

-0.09 

-0. 10 

-0.  19 

-0.12 

-0.26 

Interquart  ile 

Range 

1.35 

1.35 

1  .  35 

1  .  35 

1.36 

2.5  Percentile 

-2.01 

-2.02 

-2.05 

-2 . 02 

-2.06 

97.5  Percentile 

1.91 

1.90 

1  .84 

1 .88 

1.85 

TABLE  3.7.  Selected  percentiles  and  range  of  the  TSl.S  estimator  under  Gaussian  and 
various  scale  mixtures  of  Gaussian  errors  for  K,,  =  .10  dej;rei's  of  freedom,  a  =  5,  and 
various  '5^  . 


ERROR 

DISTRIBUTIONS 

liUANTITY 

Gauss  i  ,an 

Type  1 

Type  2 

Tvpe  3 

Cauchy 

5-  =  100 

Median 

-0.82 

-0.86 

-1 .28 

- 1  .  00 

-1.02 

Interquart ile 

Range 

1.15 

1.16 

0.92 

1 .  OH 

1.05 

2.5  Percentile 

-2.24 

-2.24 

-2.25 

-2.26 

-2 . 20 

97.5  Percentile 

1.19 

1.16 

0.82 

0.97 

1 . 04 

;S-'  =  300 

Median 

-0.50 

-0 . 54 

-0.94 

-0.62 

-0.83 

Intorciuar  t  i  le 

Range 

1.28 

1 . 30 

1 .20 

1  .26 

1.22 

2.5  Percentile 

-2.17 

-2.18 

-2.24 

-2.20 

-2.18 

97.5  Percentile 

1.58 

1.55 

1.26 

1.44 

1.40 

6-  =  1000 

.Median 

-0.28 

-0.32 

-0.56 

-0.36 

-0.58 

Interquart ile 

Range 

1.33 

1.34 

1.32 

1  .32 

1.36 

2.5  Percentile 

-2.09 

-2.10 

-2.18 

-2.12 

-2.16 

97.5  Percentile 

1.77 

1.76 

1  .56 

1.71 

1  .63 

6^  =  5000 

Median 

-0.13 

-0.14 

-0.26 

-0 .  1  6 

-0. 34 

Interquart i  le 

Range 

1.34 

1.35 

I  .  35 

1  .  34 

1.42 

2.5  Percentile 

-2.03 

-2.03 

-2.09 

-2.04 

-2.10 

97.5  Percentile 

1.88 

1.88 

1 .80 

1  .86 

1.81 
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